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IN THE CLAIMS : 

1 . (Currently Amended) A method for controlling a computer using at least one video 
image of a plurality of video images, the method comprising: 

(a) capturing n video streams, n being an integer of at least two, the n video 
streams each comprising a plurality of video frames and each of the n video 
streams comprising an i mago video of a different user; 

(b) determining a location of an object in at least one of the n video streams; 

(c) controlling a program executing on the computer based on the location of the 
object; 

(d) combining the n video streams with a user interface stream generated by the 
computer operating system, thereby forming a composite video stream; 
[[and]] 

(e) providing the composite video stream for display to each of the different 
users; and 

[[(e)]K0 displaying the composite video stream. 

2. (Previously Presented) The method of claim 1 wherein capturing n video streams 
includes receiving a live video signal of a user generated by a video camera. 

3. (Previously Presented) The method of claim 1 wherein capturing n video streams 
includes receiving a stored video signal from a video storage device. 

4. (Previously Presented) The method of claim 1 wherein determining the location an 
object in at least one of the n video streams includes: 

(a) searching for a predetermined color in one of the n video streams; 
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(b) in response to locating the predetermined color, identifying an occurrence of 
the predetermined color having the largest area; and 

(c) determining coordinates of the center of the occurrence of the predetermined 
color having the largest area. 

5. (Previously Presented) The method of claim 1 wherein controlling a program 
executing on the computer based on the location of the object comprises: 

(a) analyzing motion of the object in successive video frames to determine 
presence of a control event; and 

(b) controlling the program based on the control event. 

6. (Previously Presented) The method of claim 5 wherein each of the n video streams 
comprises an image of a different computer user, the object comprises an object 
associated with the user's hand, and the control event comprises a pointer 
movement event. 

7. (Previously Presented) The method of claim 5 wherein each of the n video streams 
comprises an image of a different computer user, the object comprises an object 
located in the user's hand, and the control event comprises a mouse click event. 

8. (Previously Presented) The method of claim 1 wherein combining the n video 
streams with the user interface stream generated by the computer operating system 
includes horizontally reversing frames of the n video streams to produce a mirror 
image of the frames of the n video streams. 

9. (Previously Presented) The method of claim 1 wherein combining the n video 
streams with the user interface stream generated by the computer operating system 
includes transparently overlaying the user interface stream on the n video streams. 
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10. (Previously Presented) The method of claim 1 wherein combining the n video 
streams with the user interface stream generated by the computer operating system 
includes transparently overlaying the n video streams on the user interface stream. 

1 1 . (Previously Presented) The method of claim 1 wherein combining the n video 
streams with the user interface stream generated by the computer operating system 
includes: 

(a) adjusting a transparency level of at least one of the user interface stream 
and the n video streams; and 

(b) generating the composite stream from the user interface stream and the n 
video streams. 

1 2. (Original) The method of claim 1 1 wherein adjusting the transparency level includes 
dynamically adjusting the transparency level. 

13. (Original) The method of claim 1 wherein displaying the composite video stream 
includes projecting the composite video stream. 

14. (Canceled) 

15. (Canceled) 

16. (Currently Amended) A method for combining a plurality of video images, each 
containing an image of a user, with a computer desktop interface, the method 
comprising: 

(a) capturing n video streams, n being an integer of at least two, each video 
stream comprising a plurality of frames and each video stream comprising an 
i mago video of a different user; 
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(b) transparently combining the n video streams with a computer desktop 
generated by the computer operating system, thereby forming a composite 
video stream; [[and]] 

(cj providing the composite video stream for display to each of the different 
users; and 

[[(c)]Kd) displaying the composite video stream, wherein the composite image 
includes transparent images of the users displayed with the computer 
desktop. 

17. (Previously Presented) The method of claim 16 wherein capturing the n video 
streams includes receiving a live video signal generated by a video camera. 

18. (Previously Presented) The method of claim 16 wherein combining the n video 
streams with the user interface stream generated by the computer operating system 
includes horizontally reversing frames of the n video streams to produce a mirror 
image of the frames of the n video streams. 

19. (Previously Presented) The method of claim 16 wherein combining the n video 
streams with the user interface stream generated by the computer operating system 
includes: 

(a) adjusting a transparency level of at least one of the user interface stream 
and the n video streams; and 

(b) generating the composite stream from the user interface stream and the n 
video streams. 

20. (Original) The method of claim 1 9 wherein adjusting the transparency level includes 
dynamically adjusting the transparency level. 
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21 . (Original) The method of claim 1 6 wherein displaying the composite video stream 
includes projecting the composite video stream. 

22. (Original) The method of claim 16 wherein displaying the composite video stream 
includes displaying the composite video stream on a non-projection computer 
display device. 

23. (Previously Presented) The method of claim 1 6 wherein displaying the composite 
video stream includes displaying a mirror image of each user with the desktop. 

24. (Previously Presented) The method of claim 16 comprising controlling objects on 
the desktop in response to movement of at least one of the user images. 

25. (Previously Presented) The method of claim 24 wherein controlling objects on the 
desktop includes moving objects on the desktop. 

26. (Previously Presented) The method of claim 24 wherein controlling objects on the 
desktop includes activating programs associated with objects on the desktop. 

27. (Previously Presented) The method of claim 1 6 wherein the desktop comprises the 
desktop of a computer local to at least one of the users. 

28. (Previously Presented) The method of claim 1 6 wherein the desktop comprises the 
desktop of a computer remote from at least one of the users. 

29. (Previously Presented) The method of claim 16 wherein each of the plurality of 
video streams includes an image of a different user. 

30. (Previously Presented) The method of claim 29 comprising controlling desktop 
objects in response to movement of user images in any of the video streams. 
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31. (Currently Amended) A computer-readable storage medium conta i n i ng having 
stored thereon a set of computer-executable instructions, the set of instructions 
comprising: 

(a) n video stream capturing routines, n being an integer of at least two, each of 
the video stream capturing routines for capturing a different video stream, 
each video stream comprising a plurality of video frames and each video 
stream comprising an image of a different user; 

(b) a video frame analysis routine for determining a location of an object in at 
least some of the plurality of video frames; 

(c) a driver for controlling a program executing on the computer based on the 
location of the object; 

(d) a video compositing routine for combining the n video streams with a user 
interface stream generated by the computer operating system, thereby 
forming a composite video stream and for providing the composite video 
stream for display to each of the n users ; and 

(e) a video display routine for displaying the composite video stream. 

32. (Currently Amended) The computer-readable storage medium of claim 31 wherein 
the user interface driving routine comprises: 

(a) instructions for searching for a predetermined color in at least one of the n 
video streams; 

(b) instructions for identifying an occurrence of the predetermined color having a 
largest area; and 
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(c) instructions for determining the coordinates of the center of the occurrence of 
the predetermined color having the largest area. 

33. (Currently Amended) The computer-readable storage medium of claim 31 wherein 
the video compositing routine comprises: 

(a) instructions for adjusting the transparency level of at least one of the user 
interface stream and the n video streams; and 

(b) instructions for generating the composite stream from the user interface 
stream and the n video streams. 

34. (Currently Amended) The computer-readable storage medium of claim 31 wherein 
the video compositing routine comprises instructions for horizontally reversing 
images of the n video streams to produce a mirror image of the images of the n 
video streams. 

35. (Currently Amended) A computer program product compr i s i ng readable medium 
having stored thereon computer-executable instructions ombod i od i n a computer 
readab l e med i um for performing steps comprising: 

(a) receiving n video images, n being an integer of at least two, each video 
image including an i mago video of a different computer user; 

(b) combining the n video images with a computer desktop image; 

(c) providing the combined image for display to each of the different users; 
[[(c)]Kd) displaying the combined image; 

[[(d)]Ke) tracking a portion of at least one of the n video images in the combined 
image; and 

[[(e)]KI) manipulating objects in the desktop image based on the tracked portion. 
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36. (Currently Amended) The computer program product readable medium of claim 35 
wherein manipulating objects includes highlighting the objects. 

37. (Currently Amended) The computer program product readable medium of claim 35 
wherein manipulating objects includes moving the objects. 

38. (Currently Amended) The computer program product readable medium of claim 35 
wherein manipulating objects includes activating programs associated with the 
objects. 

39. (Currently Amended) A computer system comprising: 

(a) a display device; 

(b) n video cameras for producing n video streams, n being an integer of at least 
two, each video stream including an i mago video of a different user; and 

(c) a processing unit operatively coupled to the display device and the n video 
cameras, wherein the processing unit is adapted to: 

(i) receive the n video streams , oach v i doo stream compr i s i ng a p l ura li ty 
of v i doo frames , combine the n video streams into a composite video 
stream including the video of the different users and provide the 
composite video stream for display to the different users; 

(ii) determine a location of a predetermined object associated with a 
user in at least one of the plurality of video frames; and 

(d) (iii) control execution of a program based on the location of the object. 

40. (Previously Presented) The system of claim 39 wherein the n video cameras are 
each positioned to produce a video stream including an image of a different user. 
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41 . (Previously Presented) The system of claim 40 wherein the different users comprise 
collaborators in a distributed computer programming task. 

42. (Currently Amended) The method of claim 1 whoro i n each of tho n v i deo streams 
compr i ses an i mago of a d i fferent usor and wherein the program comprises a 
collaborative desktop application. 

43. (Previously Presented) The method of claim 42 wherein the collaborative desktop 
application allows each user to control his or her own mouse pointer on a shared 
desktop. 

44. (Currently Amended) The method of claim 1 whoro i n oach of tho n v i doo streams 
compr i ses an i mago of a d i fferent usor, wherein at least some of the users are in 
different locations and wherein the program comprises a distributed computer 
programming application. 

45. (Previously Presented) The method of claim 29 wherein the different users comprise 
collaborators in distributed computer programming task. 

46. (Currently Amended) The computer-readable storage medium of claim 31 wherein 
each of the n video streams comprises an image of a different user. 

47. (Currently Amended) The computer-readable storage medium of claim 46 wherein 
at least some of the users are in different locations. 

48. (Currently Amended) The computer-readable storage medium of claim 47 wherein 
the different users comprise collaborators in a distributed computer programming 
task. 

49. (Currently Amended) The computer program product readable medium of claim 35 
wherein each video image includes an image of a different user. 
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50. (Currently Amended) The computer program product readable medium of claim 49 
wherein the different users comprise collaborators in a distributed computer 
programming task. 
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